An Analysis of Chaotic Noise Injected to Backpropagation Algorithm in Feedforward Neural Network

نویسندگان

  • Azian Azamimi
  • Yoko Uwate
  • Yoshifumi Nishio
چکیده

There have been much interest in applying noise to neural networks in order to observe their effect on network performance. In our previous research, we have proposed a new modified backpropagation learning algorithm, in which chaotic noise is added into weight update process. By computer simulations, we confirmed that the presence of chaotic noise during weight update process in feedforward neural network can give a better convergence rate and can find a good solution in early time. Hence, in this study, we extend these results by introducing other difficult learning example and analyzing the effect of noise parameters such as noise amplitude and control parameter of chaos to the learning performance.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

بهبود بازشناسی مقاوم الگو در شبکه های عصبی بازگشتی جاذب از طریق به کارگیری دینامیک های آشوب گونه

In this paper, two kinds of chaotic neural networks are proposed to evaluate the efficiency of chaotic dynamics in robust pattern recognition. The First model is designed based on natural selection theory. In this model, attractor recurrent neural network, intelligently, guides the evaluation of chaotic nodes in order to obtain the best solution. In the second model, a different structure of ch...

متن کامل

Kernel Regression and Backpropagation Training With Noise

One method proposed for improving the generalization capability of a feedforward network trained with the backpropagation algorithm is to use artificial training vectors which are obtained by adding noise to the original training vectors. We discuss the connection of such backpropagation training with noise to kernel density and kernel regression estimation. We compare by simulated examples (1)...

متن کامل

Exact Gradient Calculation in Gamma Neural Networks

In this paper we introduce a novel algorithm for computation of the exact error gradient for a gamma network with an arbitrary feedforward topology. An approximate algorithm with reduced computational complexity referred to as Truncated Temporal Backpropagation is also developed. Time series prediction experiments using Mackey-Glass chaotic time series show improved training convergence for our...

متن کامل

Training Algorithm for Neuro-Fuzzy Network Based on Singular Spectrum Analysis

In this article, we propose a combination of an noise-reduction algorithm based on Singular Spectrum Analysis (SSA) and a standard feedforward neural prediction model. Basically, the proposed algorithm consists of two different steps: data preprocessing based on the SSA filtering method and step-by-step training procedure in which we use a simple feedforward multilayer neural network with backp...

متن کامل

Nanofluid Thermal Conductivity Prediction Model Based on Artificial Neural Network

Heat transfer fluids have inherently low thermal conductivity that greatly limits the heat exchange efficiency. While the effectiveness of extending surfaces and redesigning heat exchange equipments to increase the heat transfer rate has reached a limit, many research activities have been carried out attempting to improve the thermal transport properties of the fluids by adding more thermally c...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008